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ABSTRACT 

This paper presents a followup of selected studies on 
effective schools with a population of bilingual amd/or 
limited-English-proficient (LEP) students. Over 150 research papers 
on both effective schools and effective bilingual LEF instruction 
were reviewed. The literature was divided into three categories: (l) 
studies with a population including linguistically and culturally 
different students within a bilingual or monolingual setting; (2) 
evaluations about the degree of effectiveness of mostly 
federally-funded bilingual programs; and (3) investigations of 
effective bilingual instructional practices or features. It is 
reported that the results of a survey of 97 of the research authors 
demonstrate the limited extent to which the research literature 
recognizes LEP students in its sample populations. Implications of 
these findings for the planning and development of effective 
instructional programs for LEP students are discussed, suid 
recommendations for future research are offered. A 38-item 
bibliography is included. (MSE) 



* Reproductions supplied by EDRS are the best that can be made 

• from the original document. 



EDUCATIONAL RESOURCES II^ORMATION 

/ CENTER (ERfQ * Poimiof v««of ^pimonsttatKi^tiiAdoctf^ 

r#ct*¥fo from fr>« p«fion o* oraamtatron 

EFFECTIVE SCHOOLS RESEARCH AND 
LANGUAGE INSTRUCTION PROGRAMS 

0> Lilllam M. Malave -^^"^^^^^^^^^^^ 

^ TO THE EDUCATIONAL RESOURCES ' 

,,. INFORMATION CENTER (ERICf 

^ n>« paper ,..e«„,s . follow up of ^l«.cd Mud.« on effcnivt „h«,U 

^ -1 , Vs L ' °" "« "fool r«ea,rh 

Wll^i P-pcr aucu«« ,hc in,pl^a.H,ns of ,h«K f.„u.„p for thcZnZ 
-ml Uc«,opmcn, of cffcc..v« .„un...o„a, p„^„m» fo^ ,.i.:p ^^I"'"* 
offc« rtco.mtnU.,.o„s pert.n.„K .o fu.urclc.ah effom Tnt. field 

Statement of Purpose 

wnai txitnl it provides informal ion rclalcd fo effective h,«i;n . r - . 
language J„i,„,, ,„ ' «hc 

Review of the Literature 

cd„c l!!,n ''^r' ^^'"^ information regarding ihc 

ducata n of nunon.y language. LEP or bilirgua, sludenLs can be dividTd il 

>- ; TrT'' ""^ ^ 'ha. includes linguiM . ly and 

iurally difa-renl Mudents wifhin a bilingual or monoling'a fg 

^ . ucgrcc ol clfccdVLncvi of mosllv fctlrnlli/ f..«i.i 

O 

U sch "f ""r '^'■^•"'^•^ 'h^' ^ '""''^-J """»JH:r of effective 

U. .v^h^H,Is Mudies idenlify ,he target Mudem.> in their sample nonulat on 'l^ 
demonstrated tlut the majority of .hem n,akc no an ,;irr h "fi 
^^rdmg .he idcnffied variables and their relationship ,o th^ 



40 



NABEIt? 



performance of this population. The research brief prepared by ihe 
Educational Research Services, Inc. (1983) induUes three of these studies: 1) 
Ellis (1975) research on elementary reading;, 2) an early chUhocni study 
completed by the California State Departmettt of Education {19H0) and 3) 
Armor's (1976) study of reading achievement. Ellis reported no specific 
finding and made no recommendations related to this population. The 
California SED study reported that there are inadequate or non-existent 
means fcr assessing LEP or NEP (non-English proftcient) students, and for 
assessing bilingual education prc^rams. Some findings were included by 
Armor in his study of a reading prc^am in Los Angeles, He concluded that 
the achievement of the Mexican American student was significantly 
influenced by the particular school and classroom to which the student was 
assigned, and that the principal's assessmeiit of the teacher was an accurate 
predictor of reading achievement (1976), However, this research did not 
discern statistically significant relationships between any individual classroom 
policy/input measured and academic achievement. 

The second category of research studies related to effective instruction 
for }JEP students in the U.S. consists of evaluations of bilingual programs. 
Much of this literature desaibes typolo^es, and designs for pri^ram 
administration and implementation!. These studies attempt to diKument the 
success or lack of it of particular biiingua! programs. The literature is rich in 
program evaluations that illustrate success stories (Peoa^Hugcs and Solis, 
1980, 81; Plante, 1986; Huzar, 19'/3; Olesini, 1971; Barik et.al, 1979; 
Lagarretta, 1979). While particular language programs have been shown to 
be effective, the conclusions generally do not indicate the effect or 
relationship of specific variables on the academic achievement of the LEP 
students. Examples include: 1) the Head Start study (LaBcllc, 1^)79) that 
p/^nted achievement gains as a result of students* participation in bilingual 
programs; and 2) the AIR (DanofT, 1978), and the Baker and de Kantcr 
reports (unpublished manuscript, 1983) which presented evidence against the 
effectivemtnt of bilingual programs. Of these studies, only the AIR ref>ort 
attempted to provide some quantitative findings on the relationship between 
achievement and instructional variables. While these two reports have tKcn 
widely criticized for methodological Haws (Cervantes, 1979, McCunncIl, 1983; 
Garcia and Martinez, 1982; American Psychological AssiKiation, 1982), the 
findings have not been dismissed. Many educational researchers have taken 
these reports as a challenge to improve the quality of instruction and have 
suggested that the consequences described in these studies necessitate 
further research. 
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the Effectiveness of Services for Language-Minority Limited-English 
Prondent Students (1984) estimated the number of LEPs served by these 
programs, and provided an analytic description of the services offered. A 
second phase of this study, will attempt to determine the effectiveness of 
these services. 



The third category of studies on effective instruction for LEP students 
focuses on classroom practices. These studies cover aspects of language 
inslruction such as language sequence, classroom management and 
organization, language(s) characteristics and use, attitudes, and socio-culiural 
variables. Investigations on curricular sequencing uf languages (LI and L2) 
include support for bi>lh ptwitions: skills developed first in LI will transfer to 
L2 (Goldman. 1983). and the reverse. These findings had previously been 
supported in numerous studies in the field of bilingual education. Positive 
results in using the native language (LI) approach were confirmed in Mexico 
(Modlano, 1968). in Peru (Burns, 1968, 1970). and in the U.S. (Enrich, 1971; 
Golub, 1978). Support for L2 instruction and the transfer of sicilb to LI 
while students progress through schot)! have been documented by researchers 
in Canada (Umbcrt and Tucker, 1972; Barik, Swain and McTavish, 1974) 
and in the U.S. (Cohen, 1974). In light of contradictory findings, 
explanations have focused on social and linguistic factors such as the: (a) 
status of (he language taught and the national group it represents, (b) 
attitudes toward LI and U, and (c) degree of initial language proficiency. 

The review of the literature also showed that ci>gnilivc and cultural 
factors were found to be significant dclerminanis of producti\i(y and 
effectiveness in the classroom. Studies about cognitive factiws (Cummins, 
1978; Fishman, 1978; Durley, 1971; Giles, 1977). and cultural variables 
(Llanes, 197ft; Ramirez et. al., 19 ) have demon.Mraled that there is a 
relationship iKtween program practices and the acquisition of language by 
LEP siudems. A significant study completed by Wong-Fillmorc (1976) 
identified three factors closely related to effective classroom instruction: (1) 
the nature of the linguistic material from which the learners begin to 
construct their versions of the English language, (2) the role which social 
factors play in the acquisition process, and (3) sources of individual 
differences in the children's mastery of the new language. This study 
illustrated that: 1) children are able to use the new language in meaningful 
social settings before rule learning, (2) students must establish and maimain 
siKial contact with native speakers who can provide the help needed to learn 
the language, and 3) characteristics such as personality, inlere«:s, motivation, 
and language habits can seriously affect the ability of the learner to take full* 
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advantage of the opportunity to Icam the language in the classroom. 

FiUmore's Ihrcc-year study on 'Varialion in Bilingual Instructional 
Practices and Second Language Learning" attempts to determine whether or 
not LEP students learn English better in an all English or bilingual program. 
Preliminaiy findings revealed considerable individual differences in how well 
and how quickly chUdren learn an L2, regardless of the instructional and 
prt^'am characteristics. This variability was observed in different types of 
clais.iX)ins and appeared to be related to characteristics other than the 
learner's intelligence and motivation. The cultural background of the 
students and their initial proficiency in English were found to be important 
detennmaats of the karning behavior exhibited by particular groups of 
minority language students. The foUowing additional instructional variables 
were highlighted: quaUty of teaching, quality of classroom environment; 
quality of instruaional language (input), and availabiUty of opportunities to 
practice English in interactions with peers and teachers. 

Thtf bilingual intervention efficacy literature, which focuses on process 
data rather than achievement outcome, identifies instructional strategics of 
significant impact on student achievement such as direct instruction and 
personalized systems of instruction. Research on home/ environmental 
variable* for Hispanic students has demonstrated that, children who come 
from home environments and famUy backgrounds offering a greater variety 
of stimulating experiences «irc those which rate high on measures believed tu 
predict school performance. There is a high correlation between student 
reading in the home and academic achievement (Matus;a:k and Haskin, 
1978). There U also a high correlation between family interaction, language' 
used, and language development (Hart, 1983; Bekcr, 1977; Wcder and 
Fowler, 1984). 

Affective faaors have »-cen largely ignored in the liic.alure on Ll-P 
students' bilingualism. Collado-Herrell and f^crrell (1980) dtmonM rated 
that affective meaning is an important component of bilingualism. Hansen 
(1983) identified confidence in learning a language lesson as a determinant of 
successful language learning. 

A study designed to address the characteristics of effective bilingual 
instruction reported findings of a three year nationwide invest igaiion 
(Tikuitoff, 1980). The specific variables examined consisted of: (a) staff, (b) 
congruence of the instructional intent with the organi/4iliun and delievcry of 
instruction, (c) program consbtcncy. (d) lime spent on learning, (e) academic 
focus, (0 acting teaching behavior of teachers, and (g) school and community 
aspeas. The study demonstrated that bilingual educalii)n shares many of the 
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same characlcri&tioi cxhibilcd in other c Icctivc cducaiiunal programs cilcd 
in Ihc literature. Shared characteristics reported include: (1) a strung focus 
on academic work, (2) a high allocation of time to subject matter content and 
engagement time on tasks, (3) the use of active teaching practices. (4) the 
expression of high expectation for student performance, (5) an efficient 
classroom management, (6) the congruence between teacher intent and the 
organization of instruction, (7) the frequency of direct factual single-answer 
questions posed by the teachers instead of complex divergent questions, and 
(8) student involvement in large group instruction rather than unsupervised 
independent study. 

In addition, the study described above provided .support for two unique 
and significant bilingual instructional features: the use of two languages, and 
the use of LI cultural information during instruction. It demonstrated that a 
substantial amount of the students' native language (LI) is associated with 
positive learning behaviors for LEP students. The use of LI in itself provides 
an influential carrier of cultural information, which in turn, allows students to 
work with concepts in which they have had iirst-hand experience. It also 
allows students to identify with teachers, and it reduces discontinuities 
between the home and the schtwl. The use of Ll also lessens possible status 
difTerences in languages, resulting in an increase in mcKivation toward 
learning. 

The sum of research evidence on effective instructional practices related 
to the successful achievement of LtP sluo-nts points to. (1) instructional 
practices, both shared with effective schools and unique bilingual/second 
language instructional practices, (2) individual learner characleri.siics, and (3) 
home-environment factors. 



Methodology 



Over one hundred fifty (150) papers in effective schools and effective 
bilingual/LEP instructional practices were reviewed to identify successful 
instructional practices which address the educational needs of both 
monolingual and LEP/bilingual students. The review emphasised practices 
related to bilinguul/LEP language and academic programs. In addition, 225 
research authors were contacted to complete a survey questionnaire to 
follow up the findings of the literature review. Ouestiunnaries were mailed 
to determine if the studies: (1) included non-English or LEP students in 
their population simple; (2)included bilingual students in their population 
^sample; (3) considered whether scIuhjIs identified as effective had 
g|^(^^n-Eng'»sh, LEP or bilingual students; (4) explained if non-Enulish. 1 FP or 
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bilingual students were accouaicd and how, when classifying a school as 
efTe^ive; (S) excluded the target popubtion for the purpme of classifying a 
school as effective or ncM; (6) established any differences between schools 
that reported a bilingual population and those which reported non-English or 
LEP students; and (7) reported language-minority students (Hispanics, 
Vielnamese, Native Americans) as part of the sample population* Each of 
the authOTs identifled, received a follow up letter and an additional 
questionnaire if he/she did not answer the first questionnaire, or requested 
more information to complete the questionnaire, The authors selected 
consisted of persons who had completed studies on effective schools and 
authors of studies that included \^iables cited in the effective schools 
literature. 

Results 

Ninety*seven que^ionnaires (43%) wre returned. One fifth (21%) of 
the respondenrs were aware that their study bcluded schools which rcpo ted 
language minority students. Nineteen percent (19%) included schools that 
identified LEP students^ and less than ten percent (10%) selected schoob 
that reported bilingual stude'its. Effective schools with LEP students 
represented eighteen percent (18%) of the respondents. Effective schools 
with bilingual students represented less than nine percent (8.6%). Only three 
percent of the studies accounted for the LEPs and one percent accounted for 
the bilingual students to determine whether a school was effective or not. Six 
percent accounted for the LEP or bilingual students to determine the 
effectiveness of the selected variables (s) on the instructional/educational 
process of the respective population. Four percent indicated that they 
excluded the LEP students and one percent stated that they excluded 
bilingual students from their study. Four percent indicated that they 
established a dificrence between sch4>i>is and or classes that reported a 
bilingual vs. LEP population. 

Discussion 

These findings illustrate that only a limilcc* number of effective school 
studies indcntificd the target students in thei** sample populalion. An 
analysis of the findings demonstrated that the majority of the studies with 
LEP/bilingual students do not account for these students, and make no 
recommendation related to their needs. A more alarming fact revealed is 
that a significant number of studies did not consider the needs of these 
students an area of their concern. Comments that permeated these 
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responses include: 

- Wc did not collect uala which could enable us to answer thcw; 
questions. 

My study was not fine enough to consider st)me of the 
relevant issues you raise. 

- Schools are excluding LEP students when reporting scores 
for school improvement projects. ... I have no evidence to hack 
this suspicion other than anecdotal evidence. 

- Schtwl district policy permitted the exclusion from 
testing of any student whose command of English was ni»t 
sufficient to respt)nd to the test items. This exclusion was at 
the discretion of the school principal. 

The studies that accounted for the target pupulation stated two major 
reasons for it: to exclude students who did not score high enough to form 
part of the study or to design specific research to study th. target group. The 
larger number of studies did not ct)asidcr LEP and bilingual students an 
issue. It is also apparent that schoi»l districts have not established a policy 
regarding the exclusion or inclusion of these students when reporting scores. 

Research designed to study instructitmal practices for bilingual/LEP 
students identified 'shared" features th..l apply to schools serving mainstream 
students. In addition, these .studies singled out "unique bilingual " features 
They are: 1) ihe utili/aliun t.f LI and L2 to mediate instructional variables, 
2) social contact with native- lik-.: L2 peers and teachers, 3) the use of LI as a 
transmitter of cultural information, 4) language habits. 5) the quality of 
instructional language, and 6) ihe nature of linguistic material from which the 
child construes EngliNh. Significant home- cnvinmmenmtal factors include 
1) home attitude towards L2, 2) cultural/ethnic indcntificaiion wiih LI 3) 
interlanguage use by the family. 4) reading practices at home, 5) richnesi of 
Ihe home cx|H:riences. and 6) ihe status of Ll. Characlerislics of the learner 
which api>ear to In: significani arc: 1) initial level of L2, 2) pcrsimality 
characteristics, 3) interest, 4) moiivaiion. 5) cultural background, 6) 
confidence and valued perceived in learning L2, and 7) altiludes toward U. 

Miljor Issues 



Elfcctivc schoDls research in monolingual and bilingual inslrucliunal 
programs points to a numlvr o{ instruciitmal variables that relate to ihe 
academic achievement and l.inguagc Icarning/acquisliiion uf LEP students. 
Nevertheless, attention mu.st be dcvi.icd to the .siudy t,f addiiiimal vaiiables 
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r^^l J'"j"8'^'AicuUural perspective through the use of appropriate 
research techniques. These research techniques most expose the unique 
characleristKs of successful programs and instructional pro^ dcsignero 

Xch.r^ language (U) learner' L I 

comprehensive review of recent research and evaluation studies of progran^s 

2^ nc^r""- '^J^''' ^^'^ Baker L Je 

r^ew iL^i'Tti '"^P*'^' ^"'y investigations. A similar 

Kicntdled the foUowing methodological weaknesses: no control for 
sooocconomH: status, inadequate sample size, improper sample techniques 
or excessive atlnlion rale, no baseline or camparison data, no control Zn 
and no control for initial language dominance. They also reported signS 
differences m teacher characteristics and other confoundi^ variables, and 
msuffiaent statistical information or improper statistical appLtions (p Z 

uJ^^^^^J^I'^^-T^ 'PP^*'"' ^ •^•^ '^^'^^ literature on effective 
l^^uZ^ 'p lu'' in the majority of studies on effective instruction t 
l^L^T' r "^"''^''^ ^•^"'^^^ "'"'^P'"^' P'°»'''='"^ with the 

e1Sirnl*^;r°" '"T"' ^-^^P--^^ with the definition of 
cfrcctivcne«5. (3) limitations of the comparisons made to explain causalitv 
deviation of the norm the generalization of findings, and the ir^na^c ' of 

tLir^r?"' "T**-^'^ '""^ P^^*" '-^'^^^ t« translate 

research findmgs mio miproved programs outside the scope of the study. 

II is significant to note that two of the effccfivc bilingual instructional 
slud^s reported (RUmore. 1976; Tikunoff. 1980) provided merures to 

aLf ^ ^ '^"•'"^ instructional features, and 4) student 

amtn^'^^r""^^^^^ '^"^"^^'^ backgrounds. One study 

air ?i provided measures to ensure appropriate generalisations. 

nIT^^ comprehensive suggestions for program improvement 
Ne^rtheless. additional research efforts need to continue and^xpand to 

- specific cultural and linguistic elements, and their 
significance as mediators of inslructinal practices for LEP 
students; 

- classroom participation structures and instructional 
features which are culturally and linguistically infiuenccd 

- linguistic and culturally determined behavioral norms * 
which inn.-.ncc academic achievement and language acquisii.cn 

- instructic lal practices congruent with language 
developr, cnt activities and culturally determined learnin« 
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behavior; 

- achievement of higher level skills in addition to language 
acquisition, and basic reading and math skills; 

- achievement of affective goals such as self sufficiency, 
positive attitudes, and ability to adapt; 

• variables that dcmonsiruic long term impact which is 
reflected in upper elementary and middle school education; and 

- effective organi/aliotial variables and their relationship 
to achievement. 
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